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BaekgrOMd Of The Invention 

1 . Field of the Invention 

The present invention relates in general to communication systems such as voice 
paging systems, cellular telephone systems, text paging systems, voice mail systems, and 
15 conventional land line telephone systems and, more specifically, to methods, systems and 
apparatus for non-real-time audio and visual messaging between two messaging devices 
wherein a communication device receives visual messages from a visual message originator 
device and transmits audio messages (e.g., voice messages) to the visual message originator 
device for playback. 

20 

2. Discussion of the Background 

A conventional mobile communication device (MCD), such as a pager or a mobile 
telephone, can receive various types of messages. There are numeric pagers which receive 
only numbers such as a telephone numbers (i.e. 818-555-1212), and there are alpha/numeric 

25 pagers which can receive alpha/numeric messages (e.g., Please call me at 929-555-1212). 
Additionally, there are voice pagers which receive voice messages. In addition to receiving 
messages, pagers are often configured to transmit messages. An alpha/numeric pager may be 
configured to receive alpha/numeric messages from an Internet-based computer and to 
transmit to the Internet-based computer originator alpha/numeric reply messages. Similarly, a 

30 voice pager that receives voice messages from a telephone-based originator can be configured 
to transmit a voice message to a voice mail system for retrieval by the originator via a 
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telephone. In short, alpha/numeric pagers are configured to transmit alpha/numeric reply 
messages and voice pagers are configured to transmit voice reply messages. 

In the field of wireless messaging generally, numeric and alpha/numeric messaging is, 
by far, more bandwidth efficient than voice messaging. Radio spectrum is a dwindling 
5 resource and wireless messaging companies are increasingly sensitive to their bandwidth 
efficiencies. Better bandwidth utilization means more capacity on the system. More capacity 
equates to more customers. Hence, the wireless messaging industry has migrated from voice 
paging to alpha/numeric paging in order to provide a bandwidth efficient, robust and high 
information content messaging service for their so called "road warrior" customers. 
10 However, to date, there is no simple method for sending a message containing more 

than a small amount of information from an alpha/numeric pager. Generally, alpha/numeric 
pagers that have the ability to send messages are configured to transmit small, preprogrammed 
("canned") text messages, such as "I will call you tonight" or "yes" or "no" or "1 will reply 
later " Other alpha/numeric pagers have been configured with a miniature, QWERTY type, 
15 text keyboard. The miniature keyboards are difficult to type on because of their size. This 
makes input very slow, inaccurate and very annoying to operate. Additionally, the miniature 
size of the keyboard is still too large for a pocket-sized pager. 

Audio pagers are generally larger than keyboardless alpha/numeric pagers, in part 
because of the large speaker required in order to reproduce a high quality, audible audio 
20 message. An audio pager's battery life is lower than an alpha/numeric pager due to the 

amount of time it takes to receive a message and the amount of power required to process and 
play the message. 

One solution to the above problem is to route a mobile telephone originated voice 
reply message to a computer. However, it's simply not convenient to send a voice message 
25 via a mobile telephone, configure a computer to receive a voice reply message and then 

mentally correlate the sent and received messages together (i.e. Was the reply "sounds good to 
me" meant to be an answer to the message, "I will pay $140,000.00 for your home" or "lets 
have lunch tomorrow at the fish place"). 

A need, therefore, exists to blend audio (e.g., voice) and visual (e.g., text and/or 
30 graphics) messaging in a manner that conserves valuable bandwidth and simplifies user input 
of messages in a mobile communication device. An attempt to that end, is the so-called 
"smart phone." Smart Phones are wireless mobile telephones that have added features, 
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implying that they are smarter than the average telephone. These features may include a 
numeric and alpha/numeric messaging feature, a personal digital assistant (PDA), computer 
functions, Internet access, and aminiature keyboard. Similar to an alpha/numeric pager, 
many mobile telephones today are capable of receiving alpha/numeric messages and have the 
5 capability of connecting to the Internet for sending alpha/numeric reply messages via a 
miniature keyboard. There is a need to simplify the input of reply messages into wireless 
devices for delivery of the reply messages to the originating device, wherein both messages 
may be correlated. 

In an alpha/numeric pager messaging environment, text messages are routinely 
10 exchanged between a computer and a text pager (i.e. text in / text out). In a voice pager 
messaging environment, voice messages are routinely exchanged between a telephone 
configured voice mail system and a voice pager (i.e. voice in / voice out). In a mobile 
telephone messaging environment, as with an alpha/numeric pager, text messages routinely 
are exchanged in non real-time (i.e. text in / text out). However, mobile telephones also have 

15 me ability to make and receive real-time voice calls. More often than not, when a mobile 
telephone user receives a text message requiring some type of response, he or she will simply 
use the mobile telephone to place a real-time telephone call to the message originator. In 
many cases, the line is busy because the originator is either on the phone or connected to the 
Internet. In either case, the mobile caller is diverted to a voice mail system or answering 

20 device and is instructed to leave a message, which is then retrieved by the called person at a 
later time. 

Many people prefer to communicate by messaging as opposed to real-time 
conversation in order to manage their time. Thus, there is a need for a device that can not 
only send non real-time text messages, but also receive non real-time voice messages (i.e. text 
25 out / voice in). At the wireless side of the messaging loop, there is a need to send non real- 
time voice messages from the same mobile device that receives non real-time text messages 

(i.e. text in / voice out). 

It is widely accepted in the field of two way paging, that only a fraction of received 
messages generate a reply message response. On the other hand, when text message reception 
30 capability is combined with a mobile telephone, the mobile telephone user will attempt to 
reply much more often via a real-time voice call. Mobile telephone companies call this 
process "call completion" and it is highly favored among mobile telephone companies 
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because additional calling generates more revenue. There is a need to increase reply traffic in 
a wireless environment without decreasing the efficiency of text message delivery to a mobile 
communication device. There is also a need to simplify the input of messages in a mobile 
communication device, such as a pager or wireless mobile telephone. Finally, there is a need 
5 for a wireless messaging system that provides end to end audio and visual messaging, wherein 
only one device is required at each end of the messaging loop (e.g., computer on the one end 
and mobile communication device on the other). 

Summary. Of Th e Invention 

10 The present invention provides a communication system for integrating audio and 

visual messaging. The communication system includes a communication device for receiving 
visual messages and for transmitting voice messages to a recipient, and an integrated mail 
gateway for receiving from the communication device a voice message and addressing 
information. The integrated mail gateway is programmed to create an electronic mail 
15 (hereinafter "e-mail") message comprising the voice message. The integrated mail gateway is 
also programmed to use the addressing information to address the e-mail message, and to send 
the addressed e-mail message to the recipient. 

Preferably, the communication device is a wireless mobile communication device. 
However, this is not a requirement. The present invention is contemplated to be used with 
20 wireless as well as non-wireless communication devices. 

In one embodiment, the communication system is used by a user of a communication 
device to send a voice message in reply to a received visual message. For example, consider 
the situation where a first person uses a messaging device with Internet e-mail capability to 
transmit a visual message to a second person. The communication system of the present 
25 invention enables the second person to easily transmit a voice reply message to the first user's 
messaging device. In one embodiment, the second person uses a communication device (such 
as a conventional telephone or mobile telephone having visual message reception capability) 
to establish a telephone call with an integrated mail gateway (IMG) that preferably has access 
to the visual message sent to the second person. After the telephone call is established, the 
30 second person uses the communication device to transmit, or the communication device 
automatically transmits, to the IMG addressing information associated with the visual 
message received from the first person. For example, a keypad on the communication device 
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could be used to transmit the addressing information, or a processor in the communication 
device can be programmed to automatically transmit the addressing information. In one 
embodiment, after the IMG receives the addressing information, it prompts the second user to 
begin speaking a voice reply message for the first person after hearing a tone. The IMG 

5 records and stores the voice reply message. Optionally, the IMG will format the voice reply 
message into a conventional audio file format. The IMG then creates an e-mail message and 
includes the voice reply message in the e-mail. Optionally, the e-mail message includes at 
least part of the received visual message to which the voice message is a reply. The IMG uses 
the addressing information provided by the mobile communication device to address the e- 

10 mail message. After the e-mail message has been addressed, the e-mail message can be sent 
to the first user. Upon receiving the e-mail message, the first user's messaging device can 
play the voice reply message associated with the original visual message so that the voice 
reply message is heard by the first user. 

Further features and advantages of the present invention, as well as the structure and 

15 operation of various embodiments of the present invention, are described in detail below with 
reference to the accompanying drawings. 

Rripf rwriptinn Of The Drawings 

The accompanying drawings, which are incorporated herein and form part of the 
20 specification, illustrate various embodiments of the present invention and, together with the 
description, further serve to explain the principles of the invention and to enable a person 
skilled in the pertinent art to make and use the invention. In the drawings, like reference 
numbers indicate identical or functionally similar elements. Additionally, the left-most 
digit(s) of a reference number identifies the drawing in which the reference number first 
25 appears. 

FIG. 1 is a schematic illustration of a communication system according to the present 
invention. 

FIGS. 2A-2D are diagrams of a routing map illustrating a voice message path from a 
mobile communication device to a messaging device. 
30 FIG. 3 illustrates in block form a mobile communication device according to the 

present invention. 
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FIG. 4 is a flow diagram of a process for sending a voice reply message according to 

the present invention. 

FIG. 5 is a schematic illustration of one embodiment of an integrated mail gateway 

and electronic mail gateway. 
5 FIGS. 6A-6C are flow diagrams of a process for receiving voice messages from a 

mobile communication device. 

FIG. 7 illustrates an example of a visual message received and displayed by a 

messaging device. 

FIG. 8 illustrates an example of a reply message received and displayed by a 
10 messaging device. 

FIG. 9 illustrates an exemplary address list message. 

Inscription O f The Preferred Embodiments 
A first embodiment of the present invention is hereinafter described, with reference to 
15 the diagram of FIG. 1. FIG. 1 illustrates two mobile communication devices, a paging 

transceiver 140 and mobile telephone 145, for communicating with messaging devices 105(1), 
105(2), and 105(3), collectively referred to as messaging device 105. More specifically, the 
paging transceiver 140 and mobile telephone 145 are configured for receiving visual messages 
from and transmitting audio messages to the messaging device 105. Visual messages include 
20 such messages as text messages (i.e. alpha/numeric messages) and graphic messages, which 
can include text and graphic images. A messaging device is a device having the ability to 
send and receive visual messages. An example of a messaging device is a personal computer 
configured with e-mail software and a connection to the Internet. Messaging devices are well 
known to those skilled in the art of computers and communications. 
25 Preferably, messaging device 105 is directly connected to a data network 120 (such as 

the Internet or other like network) or connected to an internet service provider (ISP) 170(1) or 
170(2) (such as America Online) that has a connection to data network 120. ISP 170(1) and 
1 70(2) each has a point of presence including data storage and retrieval equipment for 
enabling e-mail services and file transfer as is well know to those skilled in the art of internet 
30 communications. Messaging device 105(3) is shown connecting to ISP 170(2) through PSTN 
1 10. Although this is the most common way today for messaging devices to connect to an 
ISP, other connectivity options are available, such as satellite links and cable modems. 
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Messaging device 105 is enabled for two-way e-mail and file transfer communications. Data 
network 120 is a communications network for transporting data. There are no limits to the 
type of data carried by data network 120. For example, the data can be simple text data or it 
can be voice or video. 

5 An integrated message gateway (IMG) 1 50, is connected to a public switched 

telephone network (PSTN) 1 10 for automated storage and forwarding of audio messages. 
Operation of the IMG 1 50 will be described in detail hereinafter. 

A Mobile Switching Office (MSO) 125 (also referred to as a base station) comprises 
all of the necessary equipment and software for enabling communications between mobile 
10 telephone 145 and PSTN 1 10 as well as data network 120. The MSO 125 and mobile 

telephone 145 are configured for voice communications and visual messaging. Other than the 
improvements to be described in detail hereinafter, the MSO 125 and mobile telephone 145 
components are readily available and are well known to those skilled in the art of mobile 
telephone communications. The mobile telephone system described herein may be configured 
15 to operate using various format technologies well known in the art of mobile telephone 
systems such as for example, CDMA, TDMA, GSM, N-AMPS, etc. 

A Pager Switching Office (PSO) 130 (also referred to as a base station), comprises all 
of the necessary equipment and software for enabling communications between a paging 
transceiver 140 and the PSTN 110 or the data network 120. The PSO 130 and paging 
20 transceiver 140 are configured for voice messaging from the paging transceiver 140 to the 
PSO 130 and for visual messaging from the PSO 130 to the paging transceiver 140. Visual 
messaging is well known to those skilled in the art of paging systems. Paging systems 
capable of transmitting visual messages may be purchased from Motorola, a U.S. 
manufacturer of paging equipment. Voice paging systems are also well known to those 
25 skilled in the art of paging systems. Motorola manufacturers paging systems for transmitting 
voice messages to voice pagers. Readycom of Chapel Hill, N.C. produces a system for 
transmitting voice messages to cellular voice pagers and for transmitting voice messages from 

cellular voice pagers. 

Other than the improvements to be described in detail hereinafter, the PSO 130 and 
30 paging transceiver 140 components are readily available and are well known to those skilled 
in the art of paging communications. The paging system described herein may be configured 
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to operate using various format technologies well known to those skilled in the art of mobile 
telephone systems and paging systems, such as for example Inflection, pACT, TDMA, etc. 

In operation, a user (not shown) enters an e-mail message via a keyboard (not shown) 
attached to messaging device 105. The e-mail message is addressed to one or more 
5 communication devices, such as paging transceiver 140 and/or a mobile telephone 145. The 
e-mail message is routed through the data network 120 to MSO 125 or PSO 130 for 
transmission to the designated communication device(s). 

The mobile communication device receives/retrieves and stores the e-mail message 
and, optionally, alerts the user that a message has been received. The user may view the 
10 message from a display screen on the communication device. In order to reply to the e-mail 
message, the user simply activates a reply command (e.g., the user can press a "reply" button 
or select a "reply" menu option) and then speaks a voice message into the mobile 
communication device microphone (not shown). The voice message and addressing data are 
transmitted to the wireless system operator (i.e., MSO 125 or PSO 130) and forwarded to the 
15 IMG 1 50. The IMG 150 formats the voice message into an acceptable messaging file format. 
It then creates an e-mail message with the formatted voice message attached thereto. 
Optionally, part or all of the received visual message is included in the e-mail message, thus 
providing the e-mail originator with a means to easily identify the message to which the voice 
message is a reply. The e-mail message is then sent to the ISP 170(1) for retrieval by 
20 messaging device 105(2) or is sent directly to messaging device 105(1). The user of 
messaging device 105 then listens to the formatted voice message using an audio system. 

The process of sending an e-mail message from a messaging device 105 to a mobile 
communication device is well known to those skilled in the art of wireless visual messaging 
systems. However, the integration of audio and visual messaging presents novel features 
25 never before available to a wireless service company or end user. With the present invention, 
a cellular telephone company may now offer integrated (i.e., audio/visual) messaging services 
which are transported over the Internet, thereby achieving a substantial reduction in cost. 
Cellular telephone companies are offering e-mail type text messaging to mobile telephone 
subscribers today (through the Internet). In short, the cellular telephone company is already 
30 connected to the Internet. The present invention provides new opportunities for transporting 
non real-time voice messages over a network connection that would not be possible in real- 
time. 
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Referring to FIG. 2A, there is shown a routing map illustrating a voice message path 
from a mobile telephone 145 to messaging device 105(2), wherein a remote IMG 150 is 
configured for dial up service and located between the data network 120 and the PSTN 1 10. 
A mobile user 202 speaks a voice message into the mobile telephone 145. The voice message 
5 is transmitted to the MSO 125 and routed through the PSTN 1 10 to the IMG 150. The IMG 
150 stores and formats the voice message and sends it as an e-mail through the data network 
120 to ISP 170(1). Messaging device 105(2) retrieves the voice message from service 
provider 170(1), and the voice message is played back on the messaging device 105(2) to a 
user 204. 

10 Referring to FIG. 2B, there is shown a routing map illustrating a voice message path 

from a mobile telephone 145 to messaging device 105(2) wherein IMG 150 is privately 
connected to the MSO 125. The mobile user 202 speaks a voice message into the mobile 
telephone 145. The voice message is transmitted to the MSO 125 and routed to the IMG 1 50. 
The IMG 150 stores and formats the voice message and sends it as an e-mail through the data 
15 network 120 to ISP 170(1). Preferably, IMG 150 uses data network 120 to send the voice 
message to service provider 170(1). However, one skilled in the art will appreciate that DvIG 
150 can have a direct connection to service provider 170(1), thereby bypassing data network 
120. Messaging device 105(2) retrieves the voice message from service provider 170(1), and 
the voice message is played back on the messaging device 105(2) to the user 204. 
20 Referring now to FIG. 2C, there is shown a routing map illustrating a voice message 

path from paging transceiver 140 to messaging device 105(2), wherein an IMG 150(2) is 
directly coupled with the PSO 130 and interfaced to the PSO 130 e-mail network system. A 
pager user 206 speaks a voice message into the paging transceiver 140. The voice message is 
then stored in the paging transceiver. The stored voice message is transmitted to the PSO 1 30 
25 using a paging protocol and routed to the IMG 150(2). The IMG 150(2) stores and formats 
the voice message and sends it as an e-mail through the data network 120 to ISP 170(1). The 
message is then retrieved and played by the messaging device 105(2). 

Referring to FIG. 2D, there is shown a routing map illustrating a voice message path 
from paging transceiver 140 to messaging device 105(2), wherein an IMG 150 is privately 
30 networked to ISP 1 70(1). A pager user 206 speaks a voice message into the paging 

transceiver 140. The voice message is transmitted to the PSO 130 and routed to a IMG 150 
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where the voice message is formatted and sent via the ISP 170(1) and continues as previously 
described. 

As illustrated above, a voice message may be routed from a mobile communication 
device 140, 145 to a messaging device 105 utilizing a variety of message routing designs. It is 
5 important to note that the voice message may be routed through one particular path while a 
visual message may be routed through a different path. For example, a text e-mail message 
may be routed from the messaging device 105(1) through the data network 120 to an e-mail 
server and short messaging service at the MSO 125. From the MSO 125, the visual e-mail 
text message is transmitted to the mobile telephone 145. The e-mail message is viewed by the 
10 user and the user speaks a voice reply message to be delivered back to the message originator 
at the messaging device 105(1). The voice message is then routed to the messaging device 
105(1) through one of, or a variation of, the routes previously described. The system operator 
is given the option to choose a two-way messaging system for voice and visual messaging that 
utilizes the most efficient delivery path for routing messages depending on the type of 
15 message to be delivered or received (i.e. audio or visual). An MSO 125 or PSO 130 may now 
utilize the data network 120 for transporting voice messages. 

Prior art systems currently exist for sending e-mail text messages from a computer 
over the Internet to a mobile communication device. The present invention enables a mobile 
communication device to send a voice reply message over the Internet (or other data network) 
20 to the user that originated the e-mail text message. This is a highly desirable feature. For 

example, consider a mobile device user who is driving a car and receives an e-mail message to 
which a reply is urgently required. Such a user is unable to safely use a keyboard to enter a 
text reply message, but can easily create a voice reply message while keeping his or her hands 
on the wheel. 

25 Referring to FIG. 3, a mobile communication device, such as a mobile telephone 145 

or a paging transceiver 140, according to one embodiment is shown in block form. An 
antenna 35 1 connects to an antenna interface 352. The antenna interface 352 may be a 
duplexer or equivalent device depending on the type of mobile communication device desired. 
An antenna switch, for example, may be utilized for configuration as a paging transceiver 140 

30 or two antennas might be used, thereby eliminating the requirement for a duplexer. A receiver 
353 and a transmitter 354 are connected to the antenna interface 352 and processing module 
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355. The processing module 355 includes a microprocessor, RAM and ROM memory, 

switching, and I/O ports. 

The necessary software instructions and operating system for enabling mobile 
telephone 145 or paging transceiver 140 to receive visual messages are included and well 
5 known to those skilled in the art of mobile telephone and paging systems. Mobile telephones 
for two-way voice communications are commonly available today. Many of these mobile 
telephones receive and display visual messages such as text messages. Generally, this service 
is called Short Messaging Service or SMS. 

One format for receiving SMS is known as Cellular Digital Packet Data or CDPD. 
10 There are many variations for text messaging in mobile telephones and there are many formats 
in which the text messages may be transmitted. A few mobile telephone types that receive 
text messaging are CDMA (Code Division Multiple Access), TDMA (Time Division Multiple 
Access), and GSM (Global System for Mobile Communications). There are also a plurality of 
languages and protocols for enabling a wireless mobile telephone to communicate over the 
15 Internet. A few of them are HDML (Handheld Device Mark up Language), HDTP (Handheld 
Device Transport Protocol), TTML (Tagged Text Mark up Language) and WAP (Wireless 
Application Protocol). 

There are many prior art configurations for receiving visual messages by mobile 
telephone 145 or paging transceiver 140, and all such configurations are herein contemplated 
20 for use in combination with the novel features of the present invention. In short, it is widely 
known in the art of wireless paging systems and mobile telephone systems that paging 
transceivers and mobile telephones receive visual messages. 

The process by which a visual message, such as text, is received is not critical. 
However, the novel system and method for processing the received message information in 
25 connection with transmitting a voice reply message will be described in detail hereinafter. 

Referring again to FIG. 3, a user interface 356 connects to the processing module 355. 
The user interface 356 comprises all of the input and output devices for interaction with the 
mobile communication device such as speaker, alerting transducer, microphone, liquid crystal 
display (LCD) or light emitting diode (LED) display, switches, etc. These devices are 
30 normally included with a conventional mobile telephone having short messaging service 
features. In the case of the paging transceiver 140, amicrophone is included in the user 
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interface 356 for enabling speech input because a conventional paging transceiver for visual 
messaging does not have a microphone. 

The antenna 351, antenna interface 352, receiver 353, transmitter 354, processing 
module 355 and user interface 356 are connected in a typical mobile telephone or paging 
5 transceiver configuration. A controller 357 and memory 358 have been included for 
processing of received visual messages, storage of visual messages, and processing of 
transmitted voice messages. The controller 357 comprises a conventional microprocessor of 
the type commonly used in mobile telephones and paging transceivers. The controller 357 
also includes a memory manager, I/O ports, RAM and ROM memory and all necessary 
10 software instructions required to communicate with the processing module 355, user interface 
356, and memory 358. The controller 357 connects to the processing module 355 for 
receiving and sending data, messages, and commands. The controller 357 is connected to 
memory 358 for storage and retrieval of messages and message data and to the user interface 
356 for input and output interfacing with a user. 
1 5 Continuing with FIG. 3, when a visual message is received by receiver 353, it is stored 

for reproduction by the processing module 355 in a conventional manner. The visual message 
may contain addressing data, identification data or other data corresponding to the visual 
message which is also stored. After the visual message is received, an alert may be generated 
for notifying a user that a message has been received. The user may then select a display 
20 message option provided by the user interface 356 to cause the stored visual message to be 
displayed on the user interface 356 LCD or LED display. 

When a user wishes to send a voice message in reply to a received visual message, the 
user enables a voice reply mode via user interface 356. This causes the controller 357 to read 
the necessary addressing information from the processing module 355 and memory 358 for 
25 addressing and sending the voice reply message to the originator of the received message. 
Optionally, the user may enter addressing information associated with the received visual 
message manually using a keypad, as previously described. After enabling the voice reply 
mode, the user speaks into the microphone of the user interface 356, and a real-time voice 
message is transmitted to the IMG 150 for forwarding, in non real-time, to the visual message 
30 originator (e.g., messaging device 105). In an alternative embodiment of the present 

invention, a pre-recorded voice message is transmitted to the IMG 1 50 as will be described in 
detail hereinafter. 
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When a mobile communication device receives a visual message, the mobile 
communication device also receives and stores messaging data associated with the visual 
message. This messaging data may include, but is not limited to: a reply name, a reply 
address, a reply code, a reply type code, and reply subject matter. 
5 The reply name is generally the name of the person who sent the visual message. The 

reply address may be an e-mail address such as "jsmith@hotmail.com" or an abbreviated 
address such as a sequence of letters and/or numbers that is associated with an e-mail address 
stored at the IMG 150. The reply address may also include an IMG 150 system identifier or 
e-mail system identifier or a telephone number to a particular IMG 150. The reply code is a 
10 code that corresponds to the original visual message stored at the MSO's 125 or PSO's 130 e- 
mail system or at IMG 150. The reply type code indicates the type of voice message that is 
allowable by the system (i.e. pre-recorded, real-time, analog, digital, format, etc.). The type 
code may also indicate the allowable length or size of a voice message. The reply subject 
matter may contain the original text subject matter of the received visual message. 
15 A complete system according to the preferred embodiment of the present invention 

will now be described in connection with the mobile telephone 145 and the MSO 125 system 
of FIG. 2B. The mobile telephone 145 is enabled to receive visual messages from the MSO 
125 using any number of methods previously described. The system may operate in any 
number of formats including CDMA, TDMA GSM, etc. Short messaging service (SMS) for 
20 sending text messages to a mobile telephone is well known to those skilled in the art of 
mobile telephone systems. Other methods for delivering visual messages are also very 
common. For example, a modem could be added to an analog mobile telephone or tone 
signaling could be used for transmitting text from the MSO 125 to the mobile telephone 145. 
The use of CDPD is also quite common in the art of mobile telephone systems. 
25 In order to send a visual message from the messaging device 105 to the mobile 

telephone 145, a user of messaging device 105 creates an e-mail message using an e-mail 
program, such as one provided from AOL, Lotus, Netscape or Microsoft. The e-mail message 
is sent from the messaging device 105 to the MSO 125 via data network 120. An e-mail 
gateway (EMG) 1 15 is configured at the MSO 125 for receiving the e-mail message for 
30 delivery to the mobile telephone 145. Such a configuration is well known to those skilled in 
the art of mobile telephone systems. 
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After the e-mail message is received by the EMG 1 15, the MSO 125 transmits a signal 
to the mobile telephone 145. The signal includes the e-mail message and messaging data 
associated with the e-mail message. For this example, the signal consists of a reply name of 
"John Doe," a reply code, and the e-mail message, as shown below: 

5 

From: John Doe 
To: Mary Jane 
Subject: Airport Delay 
Reply code: 12 
10 Mary, 

My Flight is Delayed. 1 now arrive at 10:00 p.m., Fit. 2216. 

The reply code is a code that is associated with the e-mail message stored in EMG 1 1 5 . The 
reply code may be any sequence of numbers or characters, such as: 12 or 123ABC. Each 
15 message stored in the EMG 1 1 5 has a unique reply code associated with it. 

The antenna 351 of mobile telephone 145 receives the signal sent from the MSO 125. 
The receiver 353 demodulates the signal to recover the e-mail message and message data 
contained in the signal. The processing module 355 stores the e-mail message and message 
data in memory and causes the user interface 356 to alert the user that a message has arrived. 
20 Upon being alerted, the user may activate the user interface 356 to cause the processor 

355 to read the stored visual message and associated messaging data from the memory and 
display it on a display screen for viewing by the user. The time at which the message was sent 
or delivered may also be displayed on the display screen. Additionally, a reply indicator, 
which is triggered by the reply code and gives an indication to the user that the visual message 
25 selected is one in which a voice reply may be sent, is displayed. After viewing the displayed 
information, the user makes a decision to send a voice reply message to the originator by 
selecting a reply option provided by the user interface. 

Referring now to FIG. 4, there is illustrated a process performed by the controller 357 
for sending a voice reply message. The process begins with step 402, where the controller 
30 357 receives an indication that the user has selected a reply option from the user interface 356 
and, thus, enters a reply mode. Flow proceeds to step 404, where the controller 357 reads the 
memory from processing module 355 for messaging data corresponding to the visual message 
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to which the user desires to reply. A pre-programmed telephone number to the MSO 125 for 
connection to the IMG 150 is also read from memory 358 or obtained from the messaging 
data. The messaging data may or may not include a reply code. If the messaging data does 
not include a reply code, the process proceeds to step 406, otherwise the process proceeds to 
5 step 412. 

In step 406, the controller 357 searches an electronic address book (hereafter "address 
book") stored in memory 358 for an address associated with the reply name that was included 
in the messaging data. If the controller 357 does not find such an address, then flow proceeds 
to step 410, otherwise flow proceeds to step 412. In step 410, the user is informed via a visual 

10 or audible indicator that there is no return address and the process ends. 

It should be noted that the reply code search at step 404 was for a code that 
corresponds to the visual message stored at the MSO 125. If the reply code does not exist, the 
reply name included in the messaging data is used to search for a corresponding address. As 
previously described, the reply code might simply be the sequence "12". Reply codes reduce 

15 air time because all of the necessary addressing information is stored at the MSO 125 and the 

reply code points to that data. 

In step 412, the controller 357 of mobile telephone 145 attempts to establish 
communications with the IMG 150 at the MSO 125 by sending the pre-programmed telephone 
number read from the memory 358 or obtained from the messaging data. This attempt is 
20 automatically accomplished by the controller 357. After step 412, flow proceeds to step 414, 
where a determination is made to see if communication is established. If communication is 
not established, flow proceeds to step 416, otherwise flow proceeds to step 418. 

In step 416, the user is informed that a connection could not be established and the 
process ends. If this occurs, the user can simply attempt to send the reply message at a later 
25 time. In step 418, the mobile telephone transmits addressing data to the IMG 150, and the 
IMG 150 transmits acceptance or error codes back to the mobile telephone 145. The 
addressing data either includes the reply code or the address determined in step 406. 

After step 418, flow proceeds to step 420, where the controller 357 checks for "invalid 
data" error messages sent from the IMG 150. If an invalid data error is detected, the controller 
30 357 tags the invalid addressing data stored in the memory 358 as invalid and reads the 
memory 358 for valid messaging data in order to correct the problem. For example, if the 
mobile telephone 1 45 sends a reply code associated with a message that is no longer available 
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to the IMG 150, the IMG 150 will send an error code to the mobile telephone 145 indicating 
that the message can not be replied to using the current reply code. 

When the controller receives this error code it reads the memory 358, to see if there is 
a name and address for the recipient stored in memory 358 (step 422). If yes, at step 428, 
5 flow proceeds to step 418 and the process continues. If the controller 357 does not find valid 
addressing data, flow proceeds to step 430 where the user is informed of the problem via an 
indicator and the process ends. 

If at step 420 it is determined that the addressing data is valid, flow proceeds to the 
message record process at step 424. At step 424, the mobile telephone 145 user is informed 
10 by the IMG 150 to begin speaking a message at the tone for the designated recipient. The 
mobile telephone user may also be informed via an LCD or any other means of indication to 
the user to begin speaking. The user may also be informed as to how much time the user may 
speak a voice message. For example, "begin speaking a 30 second message for Mary Jane at 
the tone." However, a preferred embodiment provides for a more efficient means for 
1 5 notifying a user of the amount of available record time. As previously discussed, a reply type 
code can be included in the messaging data transmitted with the visual message. The reply 
type code can include a length code indicating the amount of time allowable for a reply 
message. This feature can be very useful for a mobile telephone 145 user, in that the user is 
informed at the time the visual message is viewed, of the amount of time given to reply. This 
20 advanced notice gives the user time to compose a reply message in advance as opposed to 
finding out two seconds before recording starts. 

At step 424, the voice message is recorded by the IMG 1 50 in a manner consistent 
with conventional voice mail systems well known to those skilled in the art of voice mail 
systems. For example, the user may be given the option to review the message, delete the 
25 message, re-record the message, etc. When the user is finished recording, flow proceeds to 
step 426, where the IMG 1 50 notifies the mobile telephone 145 user that the voice message 
has been accepted and or sent and the process ends. 

As illustrated by the above process, a voice message may be sent as a reply message to 
a visual message. A number of schemes may be used to send the voice reply message to a 
30 messaging device 105 so that the messaging device 105 user knows that the voice message is 
a voice reply to a particular visual message. In one scheme, the mobile telephone 145 simply 
transmits a reply code to the IMG 1 50. The reply code corresponds to a particular visual 
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message available to the IMG 150. For example, the visual message could be stored within 
the IMG 150, MSO 125 or EMG 115. When the IMG 150 formats the voice reply message, 
the MG 1 50 can include in the reply message the particular visual message associated with 
the reply code. 

5 In another scheme, if the visual message is not available to the IMG 150, the mobile 

telephone 145 searches its memory 358 for a name or address. If found, the name or address, 
together with the received visual message or part of the received visual message, is 
transmitted along with the voice message to the IMG 1 50, which will then create an e-mail 
message containing the voice message and the received visual message or part thereof. The 
10 name or address sent to the IMG 150 is used by the IMG 150 to address the e-mail message. 

In short, if the visual message is available to the IMG 150, and the messaging data 
transmitted to the mobile telephone 145 includes a reply code, then there is no need for the 
mobile telephone 145 to transmit to the IMG 150 anything other than the voice message and 
the reply code, thereby saving valuable bandwidth. 
15 Voice messages that are not reply messages may also be initiated by the mobile 

telephone 145. The mobile telephone user may simply select a pre-stored name or address 
from a name and address book (also referred to as, "send message list") stored in memory 
.358. When the name appears on the display screen, the user simply uses the user interface to 
select a send message function and the process starts at step 412, FIG. 4. The stored name or 
20 address is utilized for addressing me voice message and me process proceeds 

described. 

Voice messages transmitted from the mobile telephone 145 may be analog or digital. 
If analog transmission is utilized, the IMG 150 converts the analog voice message to digital 
data representative of the voice message for storage and transmission to the messaging device 

25 105. If the voice message is in digital format, the digital data representative of the voice 
message may be stored directly by the IMG 1 50. 

Additionally, a voice message may be pre-recorded and stored in memory 358 for 
transmission to the IMG 150. In such a configuration, a digital signal processor and 
associated analog to digital converter may also be configured with the controller 357 in a 

30 conventional manner for recording voice messages and storing the voice messages as data in 
memory 358. If the stored voice message is to be transmitted in analog format, then a digital 
to analog converter may also be utilized for converting the voice message data stored in 
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memory 358 back to analog. For a pre-recorded voice message configuration, step 424 of 
FIG. 4 would be changed to: Recall the stored message from memory and transmit with 
associated addressing data. Optionally, the stored voice message my be compressed by 
conventional compression algorithms prior to being transmitted. 
5 In connection with the paging transceiver 140, it should be noted that a telephone call 

is not normally initiated between a paging transceiver and the pager switching office (PSO) 
300. In the case of paging transceiver 140 sending voice messages to the PSO 130, a pre- 
recorded voice message, as opposed to a real-time voice message, may be sent as previously 
described. However, at step 412, a telephone connection is not established. Step 412 would 
10 be changed to: Page PSO 1 30 utilizing a conventional voice paging protocol such as 
Inflection, pACT, etc. Step 414 would be changed to: Did the PSO 130 respond to the 
selective call (i.e. page and handshake). Finally, step 424 would be changed to: Transmit the 
pre-recorded voice message using a paging protocol. Optionally, prior to transmission, the 
pre-recorded voice message can be compressed using conventional compression algorithms to 

15 decrease air time. 

Referring now to FIG. 5, one embodiment of the IMG 150 and EMG 1 15 are shown. 
The IMG 150 comprises a voice mail system (VMS) 510 networked to a voice mail gateway 
(VMG)520. TheIMG150mayalsoincludeamailserver530(l). The EMG 115 includes a 
short messaging service (SMS) 532 and an e-mail conversion system (ECS) 531. The EMG 

20 115mayalsoincludeamailservcr530(2). Optionally, the EMG 115 and IMG 150 can share 

the same mail server 530. 

The mail server 530(2) is coupled to data network 120 and receives visual messages 
sent from messaging device 105. The ECS 531 retrieves visual messages from the mail server 
530 and reformats the messages for wireless transmission. The ECS 531 sends the 

25 reformatted messages to the SMS 532 where it is queued and sent to the MSO 125 for 
transmission to a targeted mobile telephone 145. There are many formats and systems 
available for delivering e-mail messages to the MSO 125 or PSO 130 for transmission to a 
mobile telephone 145 or paging transceiver 140, respectively. These systems are well known 
to those skilled in the art of wireless messaging. Other than the improvement described 

30 hereinafter, these systems are readily available. 

The VMS 510 is connected to the MSO 125 so that voice messages sent from mobile 
telephone 145 can be received and stored by the VMS 510. The VMS can be directly 
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connected to the MSO 125 (as shown in FIG. 2B) or the VMS 510 can be connected to the 
MSO 125 through the PSTN 110. 

The VMS 510 is an enhanced voice mail system. Voice mail systems are readily 
available from manufacturers such as Centigram Communications Corporation in San Jose, 
5 CA., Nortel Networks in Santa Clara, CA. and AVT in Kirkland, WA., to name a few. The 
VMG 520 is an enhanced voice mail gateway. Voice mail gateway systems are also readily 
available from the above manufacturers. Voice mail systems and voice mail gateways are 
generally software driven and adaptable to various messaging environments. These systems 
are easily networked for communication between different manufacturer's platforms. 
10 Additionally, these systems have evolved to the point that many have the capability of sharing 
messages and data between platforms. One such system manufacturer is Data Connection 
Limited in Enfield, England. Data Connection Limited manufactures voice mail systems, 
voice mail gateways and networking systems which will communicate utilizing a protocol 
called "Voice Profile for Internet Mail" (VMM). The VPIM protocol is a common messaging 
15 languageformetransportofvoicemessagesbetweenplatforms. VPIM additionally allows 
for the sending of voice messages from a computer or voice mail system to a voice mail 
system or computer via the Internet. Other than the improvements described hereinafter, 
voice mail systems, voice mail gateways, voice mail networks, mail servers, e-mail gateways, 
short messaging service systems, MSO systems, protocols for transmitting voice messages 
20 over the Internet and protocols for transmitting e-mail messages to a wireless transceiver are 
well known to those skilled in the art of these systems and are readily available. 

FIGS. 6A-6C illustrate a process for receiving voice messages from a mobile 
telephone 145 or paging transceiver 140 performed by the IMG 150. Referring to FIG 6A, 
the process begins in step 600, where the IMG 150 is placed in call stand-by mode where it 
25 awaitsacall. When a call is received from a mobile telephone 145, the VMS 510 receives 
from the MSO 125 subscriber identification data corresponding to the mobile telephone 145 
which placed the call (step 602). The subscriber identification data may include the phone 
number or identification of the mobile telephone 145. The name of the subscriber and the 
subscriber's messaging address, such as an e-mail address, etc., can be found by the MSO 125 
30 by cross indexing the subscriber identification data. 

After step 602, flow proceeds to step 604, where the VMS 510 accepts or rejects the 
call based on the subscriber identification data. If the call is rejected, flow proceeds to step 
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606, otherwise flow proceeds to step 608. In step 606 the call is terminated, an error message 
is transmitted to the mobile telephone 145, and flow returns to step 600. 

In step 608, the VMS 510 receives data from the mobile telephone 145. The data may 
include a request code. The request code indicates the type of action requested. For example, 
5 a request code of "01" indicates that the current request is for sending a general message, and 
a request code "02" indicates that the current request is for sending a reply message. Request 
codes may also be used for forwarding, cc, bcc, etc. The data may also include addressing 
information such as an e-mail address, an abbreviated e-mail address, a name, subject matter, 
type, a reply code, a coded address, etc. 
10 In a preferred embodiment, the present invention utilizes messaging data codes 

whenever possible in order to conserve transmission time. When a mobile telephone 145 user 
wishes to originate a message (as opposed to reply to a message), the user selects the name of 
the person to whom the message is to be sent from an address book stored in the telephone 
145. When the user activates the send message command after selecting a recipient, only the 
15 message to be forwarded to the recipient, a request code, and a coded address normally needs 
to be transmitted to the IMG 150. 

The request code directs the VMS 510 to perform an action, in this case, the example 
is to send a message. The coded address corresponds to all other information required to send 
the message to the recipient, such as the intended recipient's name, e-mail address, message 
20 type code, etc. To send a reply message, only the request code and a reply code need be sent 
together with the reply message. 

It should be noted mat there are many methods contemplated that may be used for 
finding information stored at the MSO 125 or IMG 150. A mobile telephone 145 may, for 
example, transmit the name of the message recipient. The VMS 510, may utilize the received 
25 name for looking up the associated address stored in a database associated with the IMG 150 
in order to reduce the amount of transmission time required by the mobile telephone 145. The 
mobile telephone 145 according to the preferred embodiment of the present invention does not 
transmit the actual addressing information if that information is otherwise available to the 
IMG 150 or associated interconnected systems via a coded address or the like. 
30 Referring back to FIG. 6A, after step 608, flow proceeds to step 610, where the VMS 

5 1 0 determines the request based on the received request code. The request may be to 
forward a message, reply to a message, send a general message, send a cc, send a bcc, etc. For 
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the purpose of illustration, the decision step at step 610 has been limited to send a general 
message or send a reply message. The process of sending a copy or forwarding a message, 
etc. may be readily implemented in a manner consistent with the process described in detail 
hereinafter. If at step 610, it is determined that the request is for sending a general voice 
5 message, flow proceeds to step 616, otherwise a reply message is assumed and flow proceeds 
to step 640. 

Referring to FIG 6B, at step 616, the VMS 510 determines if the message to be sent is 
completely addressed or if the VMS 510 received a coded address, which needs to be decoded 
or cross referenced. If the message to be sent is completely addressed, flow proceeds to the 

10 record voice message process, step 626. A completely addressed message would include 
information pertaining to whom the message is from. This information was acquired at step 
602 from the MSO 125, as previously described. A completely addressed message also 
includes the name and e-mail address of the recipient such, as: Bill Jones, 
"Bjones@hotmail.com". 

15 It is beneficial for the mobile telephone to transmit a complete recipient name and 

address when the mobile telephone 1 45 may be roaming in another system area where the 
IMG 150 does not have a corresponding address book. If at step 616 the VMS 510 determines 
that coded data representing a recipient was received (i.e. coded address), flow proceeds to 
step 618. At step 618, the VMS 510 searches an address book stored in its database for a 

20 corresponding match. The VMS 510 may alternatively utilize an algorithm for converting the 

code to an address or name. 

After step 618, flow proceeds to step 620, where the VMS 510 detennines if the 
recipient address can be produced from the coded information or found in the VMS 510 
address book. If at step 620 an address cannot be obtained, flow proceeds to step 622, where 
25 an error is transmitted to the mobile telephone 145, the connection is terminated and the 
process is returned. If an address is obtained at step 620 flow proceeds to step 626. 

Step 626 is a voice recording process performed by the VMS 5 10. If a real-time voice 
message is to be received by the VMS 5 10, then voice prompts are returned to the mobile 
telephone 145 (e.g., "start recording at the tone"). The VMS 510 allows a caller to review, re- 
30 record, append, erase, etc., messages in a manner consistent with typical voice mail systems. 
If, on the other hand, a non-real-time message is to be received, then voice prompts are not 
returned. A record type indicator is transmitted from the mobile telephone 145 at the 
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beginning of step 626 indicating the desired recording format (i.e., real-time vs. pre-recorded). 
A paging transceiver 140 may, for example, utilize the pre-recorded format while a mobile 
telephone 145 may utilize a real-time recording format. 

At step 626, the voice message is received from the mobile telephone 145 and 

5 recorded by the VMS 510. Recording stops after an assigned amount of time or after the 
VMS 510 receives a stop record command from the mobile telephone 145. Recording may 
also be terminated by the VMS 5 10 responsive to a noisy communications connection. When 
the recording is complete, the VMS 510 sends an acknowledgment to the mobile telephone 
145 and the communication is terminated (step 628). Flow then proceeds to step 630, where 

1 0 the VMS 5 1 0 transfers the voice message and the necessary addressing information to the 
VMG 520. 

The VMG 520 converts the voice message to a conventional audio file format suitable 
for transmission over the Internet 120 and reproduction by the destination messaging device 
105. An example of a conventional audio file format is the ".wav" format developed by 

1 5 Microsoft. The VMG 520 also creates an e-mail message comprising the converted voice 
message and uses the addressing information to address the e-mail. The converted voice 
message can be stored in a file and attached to the e-mail message. 

The addressed e-mail message is then forwarded to a mail server such as the mail 
' server 530 (step 632). The VMG 520 preferably inserts the words "voice message" in the 

20 subject line of the e-mail and inserts instructions for playing the message in the body of the e- 
mail. It is preferable that the e-mail message be given a priority level equal to primary mail s< 
that it will not be inadvertently filtered by a recipient's e-mail system that limits attachments 
or treats attachments as secondary mail. After the addressed e-mail message is delivered to 
the mail server 530, the process returns to step 600. The mail server 530 is responsible for 

25 sending the addressed e-mail message to the intended recipient. 

Refening back to FIG 6A, at step 610, if the request is for a reply, flow proceeds to 
step 640. Referring you to FIG 6C, at step 640, the VMS 510 searches for the original 
message and addressing information files for sending a reply message. This information is 
located by correlating a received reply code with an archived original message file. The 

30 original visual message data may be archived on the mail server 530, the VMG 520, the VM5 
510 or any other associated device. For this description, the archived e-mail visual message 
file is stored in an archive file on the mail server 530 for a 5 day period. 
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After step 640, flow proceeds to step 642, where the VMS 510 determines if the reply 
information corresponding to the received reply code is present in an archive file. If the reply 
information is not present, then flow proceeds to step 644, otherwise flow proceeds to step 
658. 

5 In step 644, the VMS 5 1 0 requests reply addressing information from the mobile 

telephone 145. Flow then proceeds to step 646, where the VMS 510 analyzes the information 
received from the mobile telephone 145. If the reply addressing information is complete, flow 
proceeds to the record process (step 658). If the reply information is coded, flow proceeds to 
step 648 where the address and or name is calculated or found, as previously described. Flow 
10 then proceeds to step 650 where the VMS 510 makes a determination as to the validity of 
received data. If no addressing data was received or if the data received was not valid, flow 
proceeds to step 652, where an error code is returned to the mobile telephone 145, 
communication is terminated, and the process returns to step 600. If at step 650 it is 
determined that the data is valid, flow proceeds to step 658. 
15 At step 658, if the process flow is from step 642, the "reply to" name, address, subject 

matter and text are obtained from the e-mail archive at the mail server 530 via the VMG 520 
and appended to the voice message by the VMS 510. The "mailed from" information, as 
previously described, is obtained by the VMS 510 when communication is established by 
cross indexing the subscriber identification data with the subscriber data base associated with 
20 the VMS 510. At step 658, if the process flow is from step 650 or step 646, a "reply to" 
name, address and subject matter including "mail from" information is appended or attached 
to the voice message by the VMS 510. 

It should be noted that the preferred method for receiving reply information from a 
mobile telephone 145 is to receive a reply code in order to conserve transmission time. The 
25 original message file stored in the archive at the mail server 530 provides all of the necessary 
information required to send a reply. The next preferred method for receiving reply 
information from the mobile telephone 145 is to send a coded address and subject matter. The 
coded address may then be correlated with the subscribers mailing list stored at the VMS 510 
in order to produce the name and/or address. The least favorable method is to receive from 
30 the mobile telephone 145 the complete name, complete address and subject matter. 

During step 658, the voice message is recorded by the VMS 510 in the same manner 
as described with reference to step 626. After step 658, flow proceeds to step 660 where the 
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call is terminated. The VMS 510 then sends to the VMG 520 the recorded voice message, 
addressing data, and a pointer to or the actual visual message to which the voice message is a 
reply (step 662). The VMG 520 converts the recorded voice message to an acceptable 
Internet and messaging device 105 format and packages the reply voice message with the 
5 original visual message for transmission. Flow proceeds to step 664, where the VMG 520 
forwards the packaged addressed message (i.e. audio and visual) to the mail server 530 for 
transmission to the messaging device 105, as previously described, and the process returns to 
step 600. 

FIG. 7 illustrates an example of a visual message 700 received and displayed by a 
10 messaging device 105. The visual message 700 includes a voice message in the ".wav" 
format attached thereto. Because the visual message 700 includes a voice message as an 
attachment the visual message 700 is referred to as an audio/visual message. FIG. 8 illustrates 
an example of a reply audio/visual message 800 received and displayed by a messaging device 
105 including the original visual message sent to the mobile telephone 145. If the original 
1 5 message is no longer archived (as previously described) or available to the IMG 150, the 

original message would not be included. However, the subject: Re: Airport Delay, would still 
be included. 

Referring once again to FIG. 3, the mobile telephone 145 or paging transceiver 140 
can store names and addresses or abbreviated addresses and coded addresses in an address 

20 book stored in memory 358. When the mobile telephone 145 receives a visual message, the 
user may select an "add to list" feature from the user interface 356, causing the controller 357 
to add to the address book the name and actual address of the individual who sent the 
message, along with an abbreviated or coded address corresponding to the actual address. 

As previously described, it is preferable that the mobile telephone 145 transmit coded 

25 address information representative of an actual address stored in the IMG 150. However, 

there may be times, such as when the mobile telephone is roaming in another IMG 150 system 
area, when it is necessary to transmit an uncoded name and address. In order to solve this 
problem, the mobile telephone 145, according to one embodiment, may store both the 
complete name and address and a coded address which corresponds to the complete address 

30 information stored at the IMG 150. 

When the IMG 150 sends a visual message to the mobile telephone 145, complete 
addressing information is also sent if the coded address is not already stored in memory 358 



-24- 



WO 00/59196 PCT/USOO/08261 
of the mobile telephone 145. In other words, the IMG 150 need not transmit information to 
the mobile telephone 145, if the information is already stored there. When a visual message is 
transmitted to the mobile telephone 145, the IMG 150 first sends a coded address to the 
mobile telephone 145. The controller 357 then searches for corresponding complete 
5 addressing information stored in memory 358. If a match is found, the mobile telephone 145 
indicates to the IMG 150 that a match was found. The IMG 1 50 then does not need to 
transmit the actual data. It is a simple matter for the controller 357 to insert the corresponding 
name and address in the proper place within the message indicating from whom the message 
was sent. If the complete address information including the name is not stored in the memory 
10 358, the mobile telephone 145 indicates to the IMG 150 that a match was not found. The 
IMG 150 then transmits the complete information to the mobile telephone 145 for storage. 

When the mobile telephone 145 receives a visual message from the IMG 150, the 
message is stored as previously described for viewing on an LCD type display. When a 
mobile telephone 145 user views the message, the user may elect to save the name and 
15 address. The name and address may be saved in memory 358 by selecting the "add to list- 
option on the user interface which causes the controller 357 to store the address information in 
the address book in memory 358 for addressing out-going voice messages. 

The first time that the mobile telephone 145 transmits the saved address information to 
the IMG 150 (i.e. when sending a message), the IMG 150 will issue an associated coded 
20 address to the mobile telephone 145 for storage in memory 358. The mobile telephone 145 
then adds the coded address to the entry in its address book associated with the stored address. 
The IMG 1 50 adds the address information and coded address to its address book. In this 
manner, the mobile telephone 145 need only transmit the complete address infonnation one 
time. Thereafter, only the coded address need be transmitted. 
25 A mobile telephone subscriber may also add an address to the mobile telephone 145 

address book using a messaging device 1 05. The subscriber may simply send an "address list 
message" to their own mobile telephone 145. An "address list message" is a visual message 
having a predetermined format and including a list of names and corresponding addresses. 
One example of an address list message is an e-mail message wherein the body of the e-mail 
30 includes a list of address book entries, wherein each entry includes a name and at least one 
corresponding address. FIG. 9 illustrates one embodiment of an address list message. When 
an address list message is received by the IMG 150, the IMG 150 detects that the message is 
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an address list message based on its format and reads the names and address, and transmits the 
names, addresses and corresponding coded address information to the mobile telephone 145 
for addition to the mobile telephone 145 address book. The IMG 150 also adds the same 
names, addresses and corresponding coded addresses to its address book. In an alternative 
5 embodiment, the address list message is sent to the mobile telephone 145. Upon the address 
list message being received, the controller 357 parses the message to obtain the names and 
corresponding addresses to be added to the address book. After obtaining the names and 
corresponding addresses, the controller adds them to the address book. 

The integrated voice and visual messaging system described and illustrated herein is 
10 readily adaptable to a plurality of messaging formats, protocols, modulation schemes and 
system configurations. Voice messages may be transmitted from a mobile communication 
device such as a paging transceiver 140 or a mobile telephone 145 to an integrated message 
gateway for forwarding over the Internet or other type of network to a personal computer or 
other visual messaging device. Voice messages may be transmitted to the integrated mail 
15 gateway in analog or digital format. Additionally, voice messages may be pre-recorded at the 
mobile communication device for non real-time transmission or real-time voice messages may 
be transmitted to the integrated mail gateway for forwarding in non real-time. The system is 
adaptable to various wireless telephone systems and paging systems. The mobile 
communication device may be configured in a mobile telephone, pager, wireless PDA, or 
20 other wireless device which provides visual messaging and includes means for voice 
communications. 

While various embodiments of the present invention have been described above, it 
should be understood that they have been presented by way of example only, and not 
limitation. Thus, the breadth and scope of the present invention should not be limited by any 
25 of the above-described exemplary embodiments, but should be defined only in accordance 
with the following claims and their equivalents. 
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1 . A communication system for integrating audio and visual messaging 
comprising: 

a first messaging device for transmitting a first message and receiving a second 
5 message in reply, wherein said first message includes a visual message and said second 
message includes an audio message; 

a second messaging device for receiving said first message and, in response thereto, 
transmitting reply messaging data including said audio message and addressing information 
associated with a recipient of said audio message; and 
1 o a network for enabling communication between said first and second messaging 

devices, wherein said network includes an integrated mail gateway for receiving said reply 
messaging data and, based on said reply messaging data, generating said second message for 
transmission to said first messaging device. 

j 5 2. The communication system as recited in claim 1 , wherein said second 

messaging device is a mobile telephone. 

3. The communication system as recited in claim 2, wherein said network further 
includes a mobile switching office, a data network, and a public switched telephone network, 

20 wherein said mobile switching office enables communication of said mobile telephone 

with said data network and said public switched telephone network; 

wherein said public switched telephone network enables communication of said 
mobile switching office with said integrated mail gateway; and 

wherein said data network enables communication of said mobile switching office and 
25 said integrated mail gateway with said first messaging device. 

4. The communication system as recited in claim 2, wherein said mobile 
telephone transmits and receives messages and data using a first protocol including Cellular 
Digital Packet Data protocol. 

30 
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5 . The communication system as recited in claim 2, wherein said mobile 
telephone transmits and receives messages and data using a second protocol including Code 
Division Multiple Access protocol. 

5 6. The communication system as recited in claim 2, wherein said mobile 

telephone transmits and receives messages and data using a third protocol including Time 
Division Multiple Access protocol. 

7. The communication system as recited in claim 2, wherein said mobile 

1 0 telephone transmits and receives messages and data using a fourth protocol including Global 
System for Mobile Communications protocol. 

8 . The communication system as recited in claim 2, wherein said mobile 
telephone transmits and receives messages and data using a fifth protocol including N-AMPS 

15 protocol. 

9. The communication system as recited in claim 2, wherein said mobile 
telephone transmits and receives messages and data using a sixth protocol including Handheld 
Device Markup Language protocol. 

20 

10. The communication system as recited in claim 2, wherein said mobile 
telephone transmits and receives messages and data using a seventh protocol including 
Handheld Device Transport Protocol. 

25 1 1 . The communication system as recited in claim 2, wherein said mobile 

telephone transmits and receives messages and data using a eighth protocol including Tagged 
Text Markup Language protocol. 

12. The communication system as recited in claim 2, wherein said mobile 
30 telephone transmits and receives messages and data using a ninth protocol including Wireless 
Application Protocol. 
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13. The conununication system as recited in claim 1 , wherein said second 
messaging device is a paging transceiver. 

14. The communication system as recited in claim 13, wherein said network 

5 further includes a pager switching office, a data network, and a public switched telephone 
network, 

wherein said pager switching office enables communication of said paging transceiver 
with said data network and said public switched telephone network; 

wherein said public switched telephone network enables communication of said pager 
1 0 switching office with said integrated mail gateway; and 

wherein said data network enables communication of said pager switching office and 
said integrated mail gateway with said first messaging device. 

15. The communication system as recited in claim 13, wherein said paging 

1 5 transceiver transmits and receives messages and data using a first protocol including Inflection 
protocol. 

16. The communication system as recited in claim 13, wherein said paging 
transceiver transmits and receives messages and data using a second protocol including pACT 

20 protocol. 

17. The communication system as recited in claim 13, wherein said paging 
transceiver transmits and receives messages and data using a third protocol including Time 
Division Multiple Access protocol. 



25 



18. The communication system as recited in claim 1, wherein said first messaging 
device is a general purpose computer configured to transmit and receive electronic mail 



messages. 



30 



19. The communication system as recited in claim 1 8, wherein said network 
further includes a base station, a data network, and a public switched telephone network, 
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wherein said base station enables communication of said second messaging device 
with said data network and said public switched telephone network; 

wherein said public switched telephone network enables communication of said base 
station with said integrated mail gateway; and 
5 wherein said data network enables communication of said base station and said 

integrated mail gateway with said general purpose computer. 

20. The communication system as recited in claim 19, wherein said data network is 
the internet and said first message is an electronic mail message, and wherein said base station 

1 0 includes an electronic mail gateway for processing said electronic mail message and 
forwarding at least the visual message of the electronic mail message to said second 
messaging device. 

21 . The communication system as recited in claim 20, wherein said electronic mail 
1 5 message further includes messaging data associated with the visual message, wherein said 

reply messaging data transmitted to said electronic mail gateway includes at least a part of 
said messaging data. 

22. The communication system as recited in claim 21, wherein said electronic mail 
20 gateway includes a memory for storing data including said messaging data and said visual 

message. 

23. The communication system as recited in claim 22, wherein said messaging data 
includes a reply code and wherein said reply messaging data transmitted to said electronic 

25 mail gateway includes said reply code, said electronic mail gateway identifying the stored 
messaging data and visual message corresponding to said received reply code for addressing 
said second message to said general purpose computer. 

24. The communication system as recited in claim 22, wherein said messaging data 
30 received by said second messaging device includes a reply code only without any other 

addressing information associated with the sender of the first message, and wherein said reply 
messaging data transmitted to said integrated mail gateway includes said reply code, said 
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integrated mail gateway identifying the stored messaging data and visual message based 
solely on said received reply code for addressing said second message to said first messaging 
device. 

25. The communication system as recited in claim 1 , wherein said visual message 
is a text message. 

26. The communication system as recited in claim 1 , wherein said visual message 
includes a graphics image. 

27. The communication system as recited in claim 1 , wherein said audio message 
is a voice message. 

28. The communication system as recited in claim 1, wherein said network further 
15 includes an internet service provider and a data network, wherein said internet service 

provider enables communication of said first messaging device with said data network. 

29. The communication system as recited in claim 1, wherein said network further 
includes an internet service provider, a data network, and a public switched telephone 

20 network, wherein said internet service provider enables communication of said first messaging 
device with said data network and said public switched telephone network with said data 
network. 

30. The communication system as recited in claim 1, wherein said network further 
25 includes a public switched telephone network, wherein said public switched telephone 

network enables communication of said first messaging device with said integrated mail 
gateway. 

31. The communication system as recited in claim 1, wherein said network further 
30 includes a base station, a data network, and a public switched telephone network, 

wherein said base station enables communication of said second messaging device 
with said data network and said public switched telephone network; 
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wherein said public switched telephone network enables communication of said base 

station with said integrated mail gateway; and 

wherein said data network enables communication of said base station and said 

integrated mail gateway with said first messaging device. 

32. The communication system as recited in claim 1 , wherein said second 
messaging device includes an alert for alerting a user of said second messaging device when 
said first message is received. 

33. The communication system as recited in claim 1 , wherein said first message 
further includes messaging data associated with the visual message, wherein said reply 
messaging data transmitted to said integrated mail gateway includes at least a part of said 
messaging data. 

15 34. The communication system as recited in claim 33, wherein said integrated mail 

gateway includes a memory for storing data including said messaging data and said visual 
message. 

35. The communication system as recited in claim 34, wherein said messaging data 
20 includes a reply code and wherein said reply messaging data transmitted to said integrated 
mail gateway includes said reply code, said integrated mail gateway identifying the stored 
messaging data and visual message corresponding to said received reply code for addressing 
said second message to said first messaging device. 

25 36. The communication system as recited in claim 34, wherein said messaging data 

received by said second messaging device includes a reply code only without any other 
addressing information associated with the sender of the first message, and wherein said reply 
messaging data transmitted to said integrated mail gateway includes said reply code, said 
integrated mail gateway identifying the stored messaging data and visual message based 

30 solely on said received reply code for addressing said second message to said first messaging 
device. 
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37. The communication system as recited in claim 1 , wherein said first message 
further includes messaging data associated with the visual message, said messaging data 
including a reply name identifying the name of the sender of the visual message. 

38. The communication system as recited in claim 37, wherein said second 
messaging device includes a memory for storing a list comprising names and addresses of 
message recipients, and wherein said second messaging device includes means for comparing 
the received reply name with the names included in the stored list to identify the address 
corresponding to the reply name. 

39. The communication system as recited in claim 37, wherein the address 
identified by said comparing means is included in said addressing information transmitted by 
said second messaging device. 

15 40. The communication system as recited in claim 1 , wherein said first message 

further includes messaging data associated with the visual message, said messaging data 
including a reply address identifying the address of the sender of the visual message. 

41 . The communication system as recited in claim 40, wherein said reply address 
20 includes an identifier identifying the integrated mail gateway to which the reply messaging 

data will be transmitted. 

42. The communication system as recited in claim 1 , wherein said first message 
further includes messaging data associated with the visual message, said messaging data 

25 including a reply type code indicating the type of audio message that a user of the second 
messaging device may transmit in reply to the received visual message. 

43. The communication system as recited in claim 42, wherein said reply type code 
further indicates the maximum size of the audio message that a user of the second messaging 

30 device may transmit in reply to the received visual message. 
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44. The communication system as recited in claim 1 , wherein said first message 
further includes messaging data associated with the visual message, said messaging data 
including a reply subject matter indicating the subject matter of the received visual message. 

45 . The communication system as recited in claim 1 , wherein said second 
messaging device includes means for controlling the operation of said second messaging 
device in receiving said first message and in transmitting said reply messaging data in 
response thereto. 

46. The communication system as recited in claim 45, wherein said controlling 
means includes user interface means for enabling a user of said second messaging device to 
selectively operate said second messaging device. 

47. The communication system as recited in claim 46, wherein said first message 
15 further includes messaging data associated with the visual message and wherein said second 

messaging device includes a memory for storing said messaging data. 

48. The communication system as recited in claim 47, wherein said user interface 
means includes a reply option for enabling the user to indicate that a reply to said received 

20 first message is to be generated and transmitted to the sender of the first message, and 

wherein, in response to the user selecting the reply option, the controlling means generates the 
reply messaging data to be transmitted to said integrated mail gateway. 

49. The communication system as recited in claim 48, wherein the controlling 

25 means, in generating the reply messaging data, accesses the stored messaging data associated 
with the visual message from the memory to identify the addressing information associated 
with the recipient of the audio message. 

50. The communication system as recited in claim 49, wherein said stored 

30 messaging data includes a reply code, and wherein said controlling means uses the reply code 
as the addressing information associated with the recipient of the audio message. 
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51. The communication system as recited in claim 49, wherein said stored 
messaging data includes a reply name identifying the name of the sender ofthe visual 
message, and wherein said memory further includes a list comprising names and addresses of 
message recipients stored therein, said controlling means comparing the received reply name 
with the names included in the stored list to identify the address corresponding to the reply 
name and using the address as the addressing information associated with the recipient ofthe 
audio message. 

52. The communication system as recited in claim 49, wherein said network 
further includes a base station, a data network, and a public switched telephone network, 

wherein said base station enables communication of said second messaging device 
with said data network and said public switched telephone network; 

wherein said public switched telephone network enables communication of said base 
station with said integrated mail gateway; 

wherein said data network enables communication of said base station and said 
integrated mail gateway with said first messaging device; and 

wherein said stored messaging data includes a telephone number to be used by said 
base station for establishing communication with said integrated mail gateway, said 
controlling means including said telephone number as part ofthe transmitted addressing 
20 information associated with the recipient of the audio message. 

53. The communication system as recited in claim 49, wherein said network 
further includes a base station, a data network, and a public switched telephone network, 
wherein said base station enables communication of said second messaging device 
25 with said data network and said public switched telephone network; 

wherein said public switched telephone network enables communication of said base 
station with said integrated mail gateway; 

wherein said data network enables communication of said base station and said 
integrated mail gateway with said first messaging device; and 
30 wherein a telephone number to be used by said base station for establishing 

communication with said integrated mail gateway is stored in said memory, said controlling 
means accessing said telephone number from said memory and including said telephone 
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number as part of the transmitted addressing information associated with the recipient of the 
audio message. 

54. The communication system as recited in claim 47, wherein said integrated mail 
5 gateway includes a memory for storing data including said messaging data and said visual 
message; 

wherein said messaging data received by said second messaging device includes a 
reply code; 

wherein said user interface means includes a reply option for enabling the user to 
10 indicate that a reply to said received first message is to be generated and transmitted to the 
sender of the first message; 

wherein, in response to the user selecting the reply option, the controlling means 
accesses said stored messaging data and retrieves the reply code, said controlling means 
generating the reply messaging data; and 
1 5 wherein the reply code is included as part of the reply messaging data automatically. 

55 . The communication system as recited in claim 54, wherein said reply 
messaging data is transmitted to said integrated mail gateway and wherein said integrated mail 
gateway identifies the stored messaging data and visual message corresponding to said 

20 received reply code for addressing said second message to said first messaging device. 

56. The communication system as recited in claim 47, wherein said integrated mail 
gateway includes a memory for storing data including said messaging data and said visual 
message; 

25 wherein said messaging data received by said second messaging device includes a 

reply code; 

wherein said user interface means includes a reply option for enabling the user to 
indicate that a reply to said received first message is to be generated and transmitted to the 

sender of the first message; 
30 wherein, in response to the user selecting the reply option, the user interface means 

prompts the user of said second messaging device to enter the reply code and, after entry of 
the reply code, said controlling means generates the reply messaging data; and 
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wherein the reply code entered by the user is included as part of the reply messaging 

data. 

57. The communication system as recited in claim 56, wherein said reply 

5 messaging data is transmitted to said integrated mail gateway and wherein said integrated mail 
gateway identifies the stored messaging data and visual message corresponding to said 
received reply code for addressing said second message to said first messaging device. 

58. The communication system as recited in claim 1, wherein said network further 
10 includes a base station, a data network, and a public switched telephone network, 

wherein said base station enables communication of said second messaging device 
with said data network and said public switched telephone network; 

wherein said public switched telephone network enables communication of said base 
station with said integrated mail gateway; 
15 wherein said data network enables communication of said base station and said 

integrated mail gateway with said first messaging device; and 

wherein said integrated mail gateway further receives identification data from said 
base station identifying the sender of said audio message. 



20 



59. The communication system as recited in claim 1 , wherein said second 
messaging device includes a memory for storing data and an input means for inputting data 
into the memory. 

60. In a communication system having a first messaging device, a second 
25 messaging device, and a network enabling communication between the first and second 

messaging devices, a method for integrating audio and visual messaging, comprising the steps 
of: 

transmitting a first message from the first messaging device to the second messaging 
device through the network, wherein said first message is a visual message; 
30 receiving said first message at the second messaging device; 

in response to receipt of said first message, transmitting reply information from the 
second messaging device to an integrated mail gateway, wherein the reply information 



-37- 



WO 00/59196 PCT/USOO/08261 
includes an audio message and addressing information associated with the intended recipient 

of said audio message; 

receiving said reply information at said integrated mail gateway; 

generating at said integrated mail gateway a second message comprising the audio 

5 message; 

using said addressing information to address said second message to the intended 
recipient; 

transmitting said addressed second message from the integrated mail gateway through 
the network to the first messaging device; and 
10 receiving the second message at the first messaging device for playback of the audio 

message. 

61 . A communication system for integrating audio and visual messaging, 
comprising: 

15 first means for transmitting a first message and receiving a second message in reply, 

wherein said first message includes a visual message and said second message includes an 
audio message; 

second means for receiving said first message and transmitting reply information in 
reply, wherein said reply information includes said audio message and addressing 

20 information; and 

third means for enabling communication between said first and second means, wherein 
said third means includes a fourth means for receiving said reply information from said 
second means, for generating said second message, for using said addressing information to 
address said second message, and for transmitting said second message to said first means. 

25 

62. A messaging device for receiving and replying to messages, comprising: 
a receiver for receiving a first message, wherein said first message includes a visual 
message; 

a transmitter for transmitting a second message in reply to said first message, wherein 
30 said second message includes an audio message; 

a user interface including an input device for receiving input from a user, said input 

including audio input; 
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a processor configured to receive addressing information associated with a recipient 
of the audio message and to process audio input from the user to create the second message, 
wherein the transmitter transmits the second message to a network including an integrated 
mail gateway for receiving the second message and for transmitting at least the audio message 
5 to the recipient based on said addressing information. 

63. A wireless messaging system for end-to-end audio and visual messaging, 
comprising: 

a messaging device for transmitting a first message and receiving a second message in 
10 reply, wherein said first message includes a visual message and said second message includes 
an audio message; 

a mobile communication device for receiving said first message and transmitting said 
second message in reply, wherein said second message further includes addressing 
information associated with a recipient of said audio message; 
1 5 a base station in communication with the mobile communication device; 

an electronic mail gateway for delivering said first message to the base station for 
transmission to the mobile communication device; and 

an integrated mail gateway for receiving from the base station said second message 
and for transmitting at least the audio message to said messaging device based on said 
20 addressing information. 

64. A communication system for integrating audio and visual messaging 
comprising: 

a first messaging device for transmitting a first message and receiving a second 
25 message in reply, wherein said first message includes a visual message and messaging data 
associated with replying to the first message, said messaging data including a reply code; 

a second messaging device for receiving said first message and transmitting said 
second message in reply, wherein said second message includes an audio message and said 
reply code; and 

30 a network for enabling communication between said first and second messaging 

devices, wherein said network includes an integrated mail gateway for receiving said second 
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message from said second messaging device and for transmitting at least said audio message 
to said first messaging device based on processing of said reply code. 



65. A communication system for integrating audio and visual messaging, 
5 comprising; 

a mobile communication device for receiving visual messages and for transmitting 

voice messages to a recipient; 

a base station system in communication with the mobile communication device; 
an electronic mail gateway for delivering visual messages to the base station system 
1 0 for transmission to the mobile communication device; and 

a system for receiving from the base station addressing information transmitted from 
the mobile communication device, the system being programmed to create an e-mail message 
comprising a voice message transmitted from the mobile communication device to a voice 
mail system, to use the addressing information to address the e-mail message, and to send the 
1 5 addressed e-mail message to the recipient. 

66. The communication system of claim 65, wherein the mobile communication 
device stores the entire voice message in a memory prior to transmitting it to the voice mail 



20 



system. 

67. The communication system of claim 65, wherein the voice message is 
transmitted in real-time. 



68. The communication system of claim 65, wherein the addressing information 
25 comprises an electronic mail address. 

69. The communication system of claim 65, wherein the addressing information 
comprises a code associated with an electronic mail address. 

30 70. The communication system of claim 65, wherein the addressing information is 

a reply code that was transmitted to the mobile communication device. 
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71. The communication system of claim 65, wherein the integrated mail gateway 
converts the voice message into a conventional audio file format prior to including it in the e- 
mail message. 

5 72. The commumcation system of claim 65, wherein the e-mail message further 

comprises at least part of a visual message transmitted to the mobile communication device. 

73 . A communication system for integrating audio and visual messaging, 
comprising: 

10 a communication device for transmitting an audio message and addressing information 

associated with an intended recipient of the audio signal; and 

an integrated mail gateway for receiving from the communication device the audio 

signal and the addressing information, the integrated mail gateway being programmed to 

create an e-mail message comprising the audio signal, to use the addressing information to 
15 address the e-mail message, and to send the addressed e-mail message to the intended 

recipient. 

74. The communication system of claim 73, wherein the audio signal is a pre- 
recorded voice message. 

20 

75. The communication system of claim 73, wherein the audio signal is a real-time 
voice message. 

76. The communication system of claim 73, wherein the addressing information 
25 comprises an electronic mail address. 

77. The communication system of claim 73, wherein the addressing information 
comprises a code associated with an electronic mail address. 

30 78. The communication system of claim 73, wherein the addressing information is 

a reply code that was transmitted to the communication device. 
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79. The communication system of claim 73, wherein the e-mail message further 
comprises at least part of a visual message transmitted to the communication device. 

80. The communication system of claim 73, wherein the integrated mail gateway 
5 converts the audio signal into a conventional audio file format prior to including it in the e- 

mail. 

81 . The communication system of claim 73, wherein the communication device is 
a mobile communication device. 

10 

82. The communication system of claim 81, wherein the communication device is 
a mobile phone. 

83. The communication system of claim 81, wherein the communication device is 
15 a pager. 

84. The communication system of claim 73, wherein the communication device is 
a land line communication device. 

20 gs. A communication system for integrating voice and visual messaging 

comprising: 

a visual message originator device for composing a visual message to be transmitted 
and for receiving a voice message in reply; 

a wireless selective call transceiver for receiving the transmitted visual message and 
25 for composing a voice message to be transmitted to said visual message originator device; and 
a network for communication of the voice and visual messages between said visual 
message originator device and said wireless selective call transceiver. 

86. A mobile communication device, comprising: 
30 a user interface for receiving from a user of the mobile communication device an input 

indicating that the user desires to send a voice message to a recipient; 
a microphone for receiving the voice message; and 
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a processor programmed to transmit the voice message and addressing information 
associated with the voice message to an integrated mail gateway (IMG). 

87. The mobile communication device of claim 86, wherein the addressing 
5 information is used by the IMG to address an electronic mail message to the recipient, 

wherein the electronic mail message includes the voice message. 

88. The mobile communication device of claim 86, wherein the voice message 
transmitted to the IMG is a pre-recorded voice message. 

10 

89. The mobile communication device of claim 86, wherein the voice message 
transmitted to the IMG is a real-time voice message. 

90. The mobile communication device of claim 86, wherein the addressing 
1 5 information comprises an electronic mail address of the recipient. 

91 . The mobile communication device of claim 86, wherein the addressing 
information comprises a code associated with an electronic mail address of the recipient. 

20 92. The mobile communication device of claim 86, wherein the addressing 

information is a reply code that was transmitted to the communication device. 

93. The mobile communication device of claim 86, wherein the e-mail message 
further comprises at least part of a visual message transmitted to the communication device. 

25 

94. The mobile communication device of claim 86, wherein the processor is 
programmed to read from a memory a telephone number associated with the IMG and to 
phone the IMG prior to transmitting the voice message and addressing information to the 
IMG. 

30 

95. The mobile communication device of claim 86, wherein the processor 
transmits the voice message and the addressing information using a paging protocol. 
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96. The mobile communication device of claim 86, further comprising an antenna 
coupled to the processor for enabling the processor to transmit the voice message and 
addressing information. 

5 

97. A mobile communication device for receiving a visual message and for 
transmitting a voice reply message in response to receiving the visual message, comprising: 

means for receiving a first visual message transmitted from a messaging device; 
means for displaying the visual message to a user of the mobile communication 

10 device; 

means for establishing a telephone call with an integrated mail gateway; and 
means for transmitting to the integrated mail gateway a voice message and addressing 
information from which the address of the messaging device can be determined, whereby 
upon receiving the voice message and the addressing information, the integrated mail gateway 
15 forwards a second visual message comprising the voice message to the messaging device. 

98. The mobile communication device of claim 97, wherein the voice message is a 
pre-recorded voice message. 

20 99. The mobile communication device of claim 97, wherein the voice message is a 

real-time voice message. 

100. The mobile communication device of claim 97, wherein the addressing 
information comprises an electronic mail address. 

25 

101 . The mobile communication device of claim 97, wherein the addressing 
information comprises a code associated with an electronic mail address. 

102. The mobile communication device of claim 97, wherein the addressing 
30 information is a reply code that was transmitted to the mobile communication device. 
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1 03. The mobile communication device of claim 97, wherein the second message 
further comprises at least part of a visual message transmitted to the mobile communication 
device. 

5 104. An integrated mail gateway, comprising: 

a voice mail system for terminating a telephone call originated from a communication 
device, for receiving addressing information transmitted from the communication device, the 
addressing information being associated with at least one recipient, and for recording a voice 
message transmitted from the communication device; and 

10 a voice mail gateway coupled to the voice mail system for receiving the addressing 

information and the recorded voice message from the voice mail system, for creating an e- 
mail message comprising the recorded voice message, for using the addressing information to 
address the e-mail message, and for sending the addressed e-mail message to the at least one 
recipient. 

15 

105. The integrated mail gateway of claim 104, wherein the voice message is a pre- 
recorded voice message. 

106. The integrated mail gateway of claim 104, wherein the voice message is a real- 
20 time voice message. 

107. The integrated mail gateway of claim 104, wherein the addressing information 
comprises an electronic mail address. 

25 108. The integrated mail gateway of claim 104, wherein the addressing information 

comprises a code associated with an electronic mail address. 

109. The integrated mail gateway of claim 104, wherein the voice mail gateway 
converts the recorded voice message into a conventional audio file format prior to including 
30 the voice message in the e-mail. 
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110. The integrated mail gateway of claim 1 04, wherein the communication device 
is a mobile telephone. 



111. The integrated mail gateway of claim 1 04, wherein the communication device 
5 is a conventional telephone. 

112. A paging system, comprising: 

means for receiving a page sent from a paging device, the page comprising addressing 
information and a voice message, the addressing information being associated with at least 
10 one recipient; 

means for creating an e-mail message comprising the voice message; 

means for using the addressing information to address the e-mail message; and 

means for sending the addressed e-mail message to the at least one recipient. 

15 113. The paging system of claim 112, wherein the addressing information comprises 

an electronic mail address. 

114. The paging system of claim 112, wherein the addressing information comprises 
a code associated with an electronic mail address. 

20 

115. The paging system of claim 1 12, further comprising means for converting the 
recorded voice message into a conventional audio file format prior to including the voice 
message in the e-mail. 

25 116. A pager, comprising: 

a transmitter for transmitting pages; 

a display for displaying visual messages; 

a user interface for receiving from a user of the paging transceiver an input indicating 
that the user desires to send a voice message to a recipient; 
30 a microphone for receiving the voice message; 

a memory for storing the voice message; 
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a processor programmed to cause the transmitter to transmit the voice message and 
addressing information associated with the voice message to a system for creating a message, 
attaching the voice message to the message, and using the addressing information to address 
the message. 

5 

117. The pager of claim 1 16, wherein the addressing information comprises an 
electronic mail address. 

118. The pager of claim 1 16, wherein the addressing information comprises a code 
1 0 associated with an electronic mail address. 

1 19. A system for updating an electronic address book stored in a memory, 

comprising: 

means for receiving an e-mail message; 
1 5 means for determining whether the received e-mail message includes a list of entries to 

be added to the address book, wherein an entry comprises a name and at least one 

corresponding address; and 

means operable if the determining means determines that a received e-mail message 
includes a list of entries to be added to the address book for storing the entries in the address 
20 book. 

1 20. A wireless messaging transceiver for transmitting messages to selected 
recipients identified by visual information previously received by the messaging transceiver, 
comprising: 

25 a receiver for receiving a visual message intended specifically for the wireless 

messaging transceiver, said visual message including a mailing list identifying a plurality of 
potential message recipients; 

a memory for storing said mailing list and for storing coded addressing information; 
a user interface for allowing a user of the messaging transceiver to select one or more 
30 recipients from said mailing list; 

a processor programmed to read from said memory coded addressing information 
corresponding to said one or more recipients selected by said user; and 
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a transmitter for transmitting to a remote message storage system said coded 
addressing information corresponding to said one or more recipients selected by said user and 
an associated message, whereby the remote message storage system uses said coded 
addressing information to establish the addresses corresponding to said one or more selected 
5 recipients. 

121. A communication system for integrated voice and visual messaging, 
comprising: 

a selective call transceiver for receiving visual messages intended for said selective 
10 call transceiver and for transmitting voice messages to one or more targeted recipients; 

a base station system in communication with said selective call transceiver; 

a visual mail delivery system for delivering visual messages intended for said selective 
call transceiver to said base station system for transmission to said selective call transceiver; 
and 

15 a mail store and forward system for receiving from said base station system a voice 

message that was transmitted to said base station system from said selective call transceiver, 
said mail store and forward system being programmed to communicate with said selective call 
transceiver to determine the one or more targeted recipients of the voice message, to address 
the voice message, and to forward the addressed voice message to the one or more targeted 

20 recipients. 

1 22. A wireless messaging transceiver for transmitting a voice message in response 
to receiving an visual message, comprising: 

a receiver for receiving the visual message and messaging data associated with the 

25 visual message; 

a transmitter for transmitting voice messages and messaging data; 

a memory for storage of visual messages and messaging data; 

a display for displaying visual messages stored in said memory; 

a microphone for receiving a voice message spoken by a user of the messaging 

30 transceiver; and 

a processor programmed to enable said display to display a user selected visual 
message stored in said memory, to retrieve from said memory messaging data corresponding 
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to said selected visual message, and to direct said transmitter to transmit said voice message 
and said messaging data corresponding to said selected visual message to a mail store and 
forward system. 

5 1 23 . A selective call messaging transceiver for receiving visual messages from a 

remote visual message origination device and for transmitting voice messages to said remote 
visual message origination device, comprising: 

a receiver for receiving visual messages and messaging data corresponding to visual 
message originators; 

10 a memory for storing data including said received visual messages and messaging 

data; 

a display for displaying at least a portion of a stored visual message; 
a microphone for recording a voice message; 

a transmitter for transmitting voice messages and messaging data corresponding to a 
15 visual message originator; and 

a processor programmed and configured to receive a user input command for selection 
of a visual message stored in said memory, to enable said display to display at least a portion 
of said selected visual message, to read from said memory the messaging data corresponding 
to the originator of said selected visual message, and to automatically transmit said messaging 
20 data corresponding to the originator of said selected visual message and said recorded voice 
message to a mail store and forward system. 

1 24. In a communication system for providing two-way messaging between a 
device having full text input capabilities and a wireless device that does not have full text 
25 input capabilities, the wireless device comprising: 

a display for displaying received text messages; 

a memory for storing text and audio messages and messaging data; 

a microphone for recording voice messages dictated by a user of the wireless device; 

a transmitter for transmitting voice messages and messaging data; 
30 a receiver for receiving text messages and messaging data; and 

a processor programmed to store received messaging data in said memory, to enable 
user input for reading stored messaging data from memory, to enable the display to indicate 
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the name associated with a stored messaging data, to enable recording of a voice message by 
said microphone, and to enable transmission of a voice message and messaging data, wherein 
said messaging data corresponds to said name associated with the destination of the 
transmitted voice message. 

5 

125. A communication system for end to end two-way integrated voice and visual 

messaging, comprising: 

a wireless messaging transceiver for receiving visual messages and for transmitting 

voice messages; 

10 a base station for selectively communicating with a plurality of wireless messaging 

transceivers; 

an integrated mail system for forwarding visual messages to said base station, for 
receiving voice messages from said base station, for storing said received voice messages and 
for forwarding addressed voice messages; and 
1 5 a visual message sending device for forwarding addressed visual messages to said 

integrated mail system and for receiving voice messages from said integrated mail system. 

126. A messaging system for exchanging messages of different types comprising: 
a selective call transceiver for receiving addressed visual messages including names 
20 and for transmitting combined messages, said combined messages including voice and visual 
messages, said selective call transceiver including: 

a memory for storing addressed visual messages; 

a user interface for selecting a name associated with a received visual message; 

and 

25 a processor programmed to communicate with a remote store and forward 

system to establish an address associated with a selected name for addressing a 
microphone entered voice message and at least a portion of a received visual message 
corresponding to said selected name; and 

a store and forward system programmed to communicate with said selective call 
30 transceiver, to establish an address associated with a visual message received from said 
selective call transceiver together with a voice message for forwarding said combined 
messages to a destination corresponding to a name selected at said selective call transceiver. 
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127. A messaging transceiver for transmitting voice and visual messages, 
comprising: 

a receiver for receiving visual messages including names and addresses; 

a transmitter for transmitting information; 

a memory for storing received visual messages; 

a microphone for receiving a voice message; 

a user interface for selecting a visual message; and 

a processor programmed to read user selected visual messages from said memory and 
to cause said transmitter to transmit a voice message received by said microphone and at least 
a portion of a visual message selected by said user interface. 

128. A selective call transceiver for two-way messaging, comprising: 
a receiver for receiving visual data including visual messages; 

a transmitter for transmitting voice messages; 

a microphone for input of voice messages; 

a memory for storing data including messages; and 

a processor configured to store received visual data in said memory, to access from 
said memory a user selected visual data, to enable said transmitter and said receiver to 
communicate with a remote system for establishing a destination address corresponding with 
said selected visual data and to enable said transmitter to transmit a voice message input from 
said microphone to said remote system for forwarding to a destination address associated with 
said selected visual data. 

1 29. A wireless messaging transceiver for transmitting voice messages in response 
to receiving visual messages, comprising: 

a receiver for receiving a visual message intended for said wireless messaging 
transceiver; 

a memory for storing said visual message; 

a microphone for receiving a voice message to be transmitted; 

a transmitter for transmitting voice and visual messages; 
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a processor coupled to said memory for accessing at least a portion of a stored visual 
message, for enabling said transmitter to transmit a voice message received by said 
microphone and to cause said transmitter to transmit said voice message and said accessed 
visual message. 

5 

130. In a messaging system having a plurality of messaging devices associated 
therewith, said messaging devices being capable of sending visual messages and receiving 
voice messages, a wireless messaging transceiver for receiving visual message information 
and for transmitting voice messages associated with received visual message information 

10 comprising: 

a receiver for receiving visual messages including data corresponding to a targeted 
messaging device recipient; 

a memory for storing received data and visual messages; 

a processor for accessing said received data stored in said memory to determine the 
15 identity of at least one messaging device recipient and extracting data representative of at least 
one address for addressing a voice message; 

a transmitter coupled to said processor for transmitting a voice message including said 
extracted data; and 

a microphone for receipt of said voice message to be transmitted by said transmitter. 

20 

131. A communication device for providing a voice message response to a visual 
message, comprising: 

a wireless messaging transceiver having a display for displaying received visual 
messages and a microphone for recording a voice message associated with received visual 

25 information displayed on said display, said wireless messaging transceiver including memory 
and a processor programmed to correlate displayed information with a voice message intended 
for a targeted recipient device and associated with said displayed information, said processor 
additionally programmed to communicate with a remote store and forward system for 
automatically establishing an address associated with a voice message recorded into said 

30 microphone and transmitted by said wireless messaging transceiver to said store and forward 
system. 
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132. A wireless telephone for receiving visual information, comprising: 
a memory for storing at least the name associated with a visual message received by 
said wireless telephone; 

a user interface for selecting one of a plurality of received names; and 
5 a processor programmed to sequence a communication protocol, to enable 

communication with a remote voice mail system for automatically enabling transmission by 
said wireless telephone of a voice message targeted to an address coiTesponding to a name 
selected by the user interface and corresponding to previously received visual information. 

10 133. A messaging system, comprising: 

a base station for transmitting visual mail and for receiving voice mail; 
a plurality of addressable transceivers; 

an integrated messaging system operatively coupled to said base station for correlating 
visual mail with voice mail, said integrated messaging system comprising: 
15 a visual mail system for transmission of visual mail and messaging data to an 

addressable transceiver; 

a voice mail system for storing voice messages and messaging data transmitted 
by an addressable transceiver; and 

a data base for cross referencing visual messaging data transmitted to an 
20 addressable transceiver with a voice message received from said addressable 

transceiver. 

1 34. A method for sending from a communication device a voice message, wherein 
the voice message is a reply to a visual message received at the communication device, 
25 comprising the steps of: 

receiving an indication that a user of the communication device has selected a reply 
option from a user interface of the communication device; 

determining whether messaging data associated with the visual message includes a 
reply code; 

30 if the messaging data includes a reply code, then transmitting the reply code to a 

system that forwards the voice message to an intended recipient; 
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if the messaging data does not include a reply code, then searching an address book 
stored in the communication device for addressing data associated with a reply name included 
in the messaging data and transmitting the addressing data to the system; and 
transmitting the voice message to the system. 

5 

135. The method of claim 134, wherein the reply code is not an address, but is used 
by the system in determining the address of an intended recipient of the voice message. 

1 36. The method of claim 1 34, wherein at least part of the received visual message 
1 0 is transmitted to the system. 

137. The method of claim 135, wherein the reply code corresponds to a particular 
visual message. 

15 138. The method of claim 137, wherein the particular visual message is available to 

the system. 

1 39. The method of claim 1 37, further comprising the step of receiving an error 
message transmitted from the system if the reply code was transmitted to the system and the 

20 particular visual message is not available to the system. 

1 40. The method of claim 139, further comprising the steps of: 

searching the address book stored in the communication device for addressing data 
associated with the reply name; and 
25 transmitting the addressing data to the system. 

141 . The method of claim 139, further comprising the step of deleting the reply 
code from the communication device. 

30 1 42. A communication device, comprising: 
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a user interface for receiving from a user of the communication device an input 
indicating that the user desires to send to a recipient an electronic mail message having a voice 
message attached thereto, wherein the user interface does not include means for inputting text; 
a microphone for receiving the voice message; and 
5 a transmitter for transmitting to a system for creating and sending the electronic mail 

message the voice message and addressing information for addressing the electronic mail 
message. 

1 43 . The communication device of claim 1 42, wherein the addressing information 
10 comprises an electronic mail address. 

144. The communication device of claim 142, wherein the addressing information 
comprises a code corresponding to an electronic mail address. 

15 1 45 . The communication device of claim 1 42, wherein the addressing information 

comprises a reply code that was transmitted to the communication device. 

1 46. A mobile communication device, comprising: 

a user interface for receiving from a user of the mobile communication device an input 
20 indicating that the user desires to send to a recipient an electronic mail message having a voice 
message attached thereto; 

a microphone for receiving the voice message; and 

a transmitter for transmitting to a system for creating and sending the electronic mail 
message the voice message and addressing information for addressing the electronic mail 
25 message. 

1 47. The mobile communication device of claim 146, wherein the mobile 
communication device is a pager. 

30 148. The mobile communication device of claim 1 47, wherein the transmitter 

transmits the voice message to the system using a paging protocol. 
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149. The mobile communication device of claim 146, wherein the mobile 
communication device is a cellular telephone. 



150. The mobile communication device of claim 146, wherein the addressing 
5 information comprises an electronic mail address. 

151. The mobile communication device of claim 146, wherein the addressing 
information comprises a code corresponding to an electronic mail address. 

10 1 52. The mobile communication device of claim 1 46, wherein the addressing 

information comprises a reply code that was transmitted to the mobile communication device. 

153. A method of using a telephone to send to a recipient an electronic mail 
message having a voice message attached thereto, comprising the steps of: 

15 placing a telephone call to a system for creating and sending the electronic mail 

message; 

transmitting addressing information to the system; 

receiving a prompt from the system to begin speaking the voice message; and 
after receiving the prompt, receiving a voice message dictated into the telephone; 
20 as said voice message is being received, transmitting it to the system, whereby the 

system records the voice message; and 
terminating the telephone call. 

1 54. The method of claim 1 53 , wherein the system creates the electronic mail 

25 message, uses the addressing information to address the electronic mail message, attaches the 
voice message to the electronic mail message, and sends the electronic mail message. 

155. The method of claim 153, further comprising the step of receiving an 
indication that a user of the telephone has selected a user interface option that indicates that 

30 the user desires to send a voice message to the recipient. 
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1 56. The method of claim 155, wherein the user selects the user interface option by 
selecting a menu item from a menu displayed on a display screen of the telephone. 



157. The method of claim 155, wherein the user selects the user interface option by 
5 depressing a particular button on the telephone. 

158. The method of claim 155, wherein the step of placing the telephone call to the 
system for creating and sending the electronic mail message is performed automatically by a 
controller within the telephone in response to the activation of the user interface option. 

10 

159. The method of claim 153, further comprising the step of enabling a keypad on 
the telephone for the user to manually input the addressing information. 

160. The method of claim 153, wherein the addressing information is stored in a 
1 5 memory within the telephone. 

161. The method of claim 1 60, wherein a controller within the telephone 
automatically reads the addressing information from the memory so that a user of the 
telephone need not manually input the addressing information into the telephone so that it can 

20 be transmitted to the system. 

1 62. A method of using a pager having a built in microphone to send to a recipient 
an electronic mail message having a voice message attached thereto, comprising the steps of: 

receiving a voice message dictated into the microphone; 
25 as the voice message is being received, storing the voice message in a memory within 

the pager; 

transmitting the voice message to a base station, which forwards the voice message to 
a system for creating and sending the electronic mail message; and 

transmitting addressing information to the base station, which forwards the addressing 
30 information to the system, wherein the addressing information is to be used by the system in 
addressing the electronic mail message. 
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163. The method of claim 162, wherein the system creates the electronic mail 
message, uses the addressing information to address the electronic mail message, attaches the 
voice message to the electronic mail message, and sends the electronic mail message. 

5 1 64. The method of claim 1 53 , further comprising the step of receiving an 

indication that a user of the pager has selected a user interface option that indicates that the 
user desires to send a voice message to the recipient. 

165. The method of claim 164, wherein the user selects the user interface option by 
1 0 selecting a menu item from a menu displayed on a display screen of the pager. 

166. The method of claim 164, wherein the user selects the user interface option by 
depressing a particular button on the pager. 

15 167. The method of claim 1 62, further comprising the step of enabling a keypad on 

the pager for the user to manually input the addressing information. 

168. The method of claim 162, wherein the addressing information is stored in a 
memory within the pager. 

1 69. The method of claim 1 68, wherein a controller within the pager automatically 
reads the addressing information from the memory so that a user of the pager need not 
manually input the addressing information into the pager so that it can be transmitted to the 
system. 

1 70. A communication system, comprising: 

a first device for creating and sending an electronic mail (e-mail) message, wherein 
said e-mail message comprises one or more names and comprises addressing information 
associated with each of said one or more names; and 

a second device for receiving said e-mail message, wherein said second device 
comprises: 

a memory; 



20 



25 



30 
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an address book stored in said memory; and 

a processor programmed to automatically add said one or more names and 
associated addressing information to said address book. 



5 171. The communication system of claim 1 70, further comprising a system for 

receiving said e-mail message from said first device and for forwarding said e-mail message 
to said second device, wherein said system stores said one or more names and associated 
addressing information in a memory within the system. 

10 1 72 . The communication system of claim 171, wherein, before said system forwards 

said e-mail message to said second device, said system replaces said addressing information in 
the e-mail with a coded address, so that said e-mail received by said second device comprises 
one or more names and associated coded addresses, 

15 1 73 . The communication system of claim 171, wherein said system comprises: 

means for receiving a name and an actual address from said second device; 
means for generating a coded address corresponding to said actual address; and 
means for transmitting said coded address to said second device, wherein said 
processor of said second device adds said coded address to said address book. 
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